AutoML Leaderboard

Best model name model_type metric_type metric_value train_time single_prediction_time
1_Linear Linear logloss 0.192042 14.19 0.042
2_Default_LightGBM LightGBM logloss 0.13902 5.93 0.0168
3_Default_Xgboost Xgboost logloss 0.1365 8.05 0.016
4_Default_CatBoost CatBoost logloss 0.125332 5.19 0.0165
5_Default_NeuralNetwork Neural Network logloss 0.261498 4.51 0.041
6_Default_RandomForest Random Forest logloss 0.236473 7.58 0.165
11_LightGBM LightGBM logloss 0.152876 6.06 0.0135
7_Xgboost Xgboost logloss 0.171097 6.54 0.0158
15_CatBoost CatBoost logloss 0.12676 8.29 0.017
19_RandomForest Random Forest logloss 0.197129 10.01 0.1383
23_NeuralNetwork Neural Network logloss 0.232964 5.38 0.0523
12_LightGBM LightGBM logloss 0.130602 6.08 0.012
8_Xgboost Xgboost logloss 0.13694 6.03 0.0188
16_CatBoost CatBoost logloss 0.129666 7.96 0.0144
20_RandomForest Random Forest logloss 0.230631 9.4 0.1384
24_NeuralNetwork Neural Network logloss 0.192402 6.17 0.0421
13_LightGBM LightGBM logloss 0.140203 6.97 0.0131
9_Xgboost Xgboost logloss 0.381057 6.72 0.0181
17_CatBoost CatBoost logloss 0.120144 7.32 0.0138
21_RandomForest Random Forest logloss 0.281769 10.33 0.1615
25_NeuralNetwork Neural Network logloss 0.244839 6.8 0.0351
14_LightGBM LightGBM logloss 0.134268 8.15 0.0129
10_Xgboost Xgboost logloss 0.693123 6.15 0.0157
18_CatBoost CatBoost logloss 0.128354 8.59 0.0212
22_RandomForest Random Forest logloss 0.282002 10.83 0.1673
26_NeuralNetwork Neural Network logloss 0.190663 6.95 0.0432
17_CatBoost_GoldenFeatures CatBoost logloss 0.123813 8.65 0.0347
4_Default_CatBoost_GoldenFeatures CatBoost logloss 0.123543 8.29 0.048
15_CatBoost_GoldenFeatures CatBoost logloss 0.129454 10.4 0.0416
17_CatBoost_RandomFeature CatBoost logloss 0.125614 9.27 0.0223
17_CatBoost_SelectedFeatures CatBoost logloss 0.11511 8.66 0.0148
12_LightGBM_SelectedFeatures LightGBM logloss 0.126824 8.88 0.0197
3_Default_Xgboost_SelectedFeatures Xgboost logloss 0.135841 8.68 0.0303
26_NeuralNetwork_SelectedFeatures Neural Network logloss 0.159097 7.93 0.0448
19_RandomForest_SelectedFeatures Random Forest logloss 0.21026 11.56 0.1325
27_CatBoost_SelectedFeatures CatBoost logloss 0.115485 8.83 0.0219
28_CatBoost_SelectedFeatures CatBoost logloss 0.12736 10.02 0.017
29_CatBoost CatBoost logloss 0.120864 9.01 0.0177
30_LightGBM_SelectedFeatures LightGBM logloss 0.126824 9.11 0.0138
31_LightGBM_SelectedFeatures LightGBM logloss 0.126824 9.07 0.0123
32_LightGBM LightGBM logloss 0.130602 9.15 0.0137
33_LightGBM LightGBM logloss 0.130602 9.24 0.0136
34_Xgboost_SelectedFeatures Xgboost logloss 0.138084 9.43 0.0212
35_Xgboost_SelectedFeatures Xgboost logloss 0.13483 9.38 0.0166
36_Xgboost Xgboost logloss 0.136081 10.38 0.016
37_Xgboost Xgboost logloss 0.137424 9.55 0.0146
38_NeuralNetwork_SelectedFeatures Neural Network logloss 0.189926 9.05 0.0358
39_RandomForest Random Forest logloss 0.210377 12.53 0.1249
40_RandomForest_SelectedFeatures Random Forest logloss 0.211415 13.5 0.1831
41_CatBoost_SelectedFeatures CatBoost logloss 0.114777 11.26 0.0229
42_CatBoost_SelectedFeatures CatBoost logloss 0.122772 10.36 0.0184
43_CatBoost_SelectedFeatures CatBoost logloss 0.118655 11.15 0.0237
44_CatBoost_SelectedFeatures CatBoost logloss 0.111754 10.41 0.0159
45_LightGBM_SelectedFeatures LightGBM logloss 0.130249 10.81 0.0148
46_LightGBM_SelectedFeatures LightGBM logloss 0.130249 11.08 0.0125
47_Xgboost_SelectedFeatures Xgboost logloss 0.165658 12.23 0.0175
48_Xgboost_SelectedFeatures Xgboost logloss 0.163618 13.03 0.0176
49_NeuralNetwork_SelectedFeatures Neural Network logloss 0.203407 10.54 0.0333
50_NeuralNetwork_SelectedFeatures Neural Network logloss 0.178132 10.94 0.0357
51_NeuralNetwork_SelectedFeatures Neural Network logloss 0.249332 10.38 0.0332
52_NeuralNetwork_SelectedFeatures Neural Network logloss 0.206625 10.83 0.0441
53_RandomForest Random Forest logloss 0.198354 14.86 0.1326
54_RandomForest_SelectedFeatures Random Forest logloss 0.206369 13.63 0.1571
the best Ensemble Ensemble logloss 0.10497 15.52 0.1125

AutoML Performance

AutoML Performance

AutoML Performance Boxplot

AutoML Performance Boxplot

Features Importance

features importance across models

Spearman Correlation of Models

models spearman correlation